Towards an Extensible Middleware for Database Benchmarking
نویسندگان
چکیده
Today’s database benchmarks are designed to evaluate a particular type of database. Furthermore, popular benchmarks, like those from TPC, come without a ready-to-use implementation requiring database benchmark users to implement the benchmarking tool from scratch. The result of this is that there is no single framework that can be used to compare arbitrary database systems. The primary reason for this, among others, being the complexity of designing and implementing distributed benchmarking tools. In this paper, we describe our vision of a middleware for database benchmarking which eliminates the complexity and difficulty of designing and running arbitrary benchmarks: workload specification and interface mappers for the system under test should be nothing but configuration properties of the middleware. We also sketch out an architecture for this benchmarking middleware and describe the main components and their requirements.
منابع مشابه
Current Trends in Middleware Benchmarking
The paper provides a brief overview of the state of the art in middleware benchmarking. The overview is used to highlight some of the outstanding issues in the area, specifically the issues related to implementing, running and evaluating regression benchmarks. The issues are analysed in depth and the course of our work towards resolving them is presented.
متن کاملRegression Benchmarking in Middleware Development
The paper advocates the concept of regression benchmarking as a part of middleware development and quality assurance process and highlights some of the outstanding issues related to implementing, running and evaluating regression benchmarks. The issues are analyzed in depth and the course of our work towards resolving them is presented.
متن کاملPerformance Analysis of the OGSA-DAI Software
This paper describes the experiences of the OGSA-DAI team in profiling and benchmarking components of the OGSA-DAI database access middleware built using the Open Grid Services Infrastructure and the emerging Database Access and Integration Services Global Grid Forum recommendations. The profiling approach and the tools used are described. A number of areas of concern are then analysed in detai...
متن کاملAvailability Benchmarking of a Database System
We present the results of an availability benchmarking study of a three-tier transactionprocessing-oriented database system based on Microsoft SQL Server 2000. Following the general availability benchmarking methodology introduced by our previous work on software RAID systems, we carried out a set of fault-injection experiments in which we measured the effects of 14 different types of realistic...
متن کامل